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This report pr^^nts the set of evaluation guidelines 
and instruM.ents prepared for the^val^ation of the Comprehensive 
Program for Science- Teacher Education at the Oniyers^ty of South 
Dakota, The participants in\thB stzjdy ver^e inservirre seconclary 
science teachers enrolled in the Coiaprehensive Program. The 
participants- were .pre- and post-tested in: science subject matter , 
competency; understanding of science; attitudes toward mathematics^ 
science^ science teachi^ag^^ jjid lalioratQj^s^ work; and t*he 'nature of thf 
science classroom ajid labor^itory activities yhich the participants- 
feel should be us^d for secondary sch'ool* science instruction. The 
dati resulting from* thes.e tests are^ reported and /inalyzed^ along with 
an extensive profile of the participants^ tejiching experience. Among 
the conclusioft6 derived from the data were: little change was noted 
on the participant* attitude measures used as. pre- and post-tests; in 
^^gen^ralr participants Vere pleased with the program; the participants 
'entered tKe program iii genetrallj good agreemept with ^science 
educators as to the types of ^ actjL.viti es which should be used*' for 
secondary , Science instruction, and the program strengthened this" ' , 
"'agr^^ment; a-nd the pai;ticipants, showed sig'nificant progress in 
subject matter "competencies .by the compl-etion of-th^ progra^m. 
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OVLRVICV • ' 

A, Introduf:tlon * . • ' - •'^ . 

ihe accompanying set of evaluation guidelines and instruments have ^iJfeen •prepared 
for the piirpose of , Evaluating the 'Compreli^nsive Program for Science i'eaclier education 
at the Iniversity of South Dakota. An ^extensive profile of measures has been, ^s- 
^tablished (soine are uftder development) ""so that a total evaluation as well as an * 
evaluation of each pUase can be obtained. The evaluati9n «is viewed as being develop- 
mental and will be modif i6(i «Cd is dictated by the 'evaluation needs of the Comprehensive 
Program,- It must als^^ be enphasize'd t!hat information from the evaluation will receive 

major consideration in prograiQ decision-maki(tig. ' ' . * • 

• • /, 

The following general « procedural information is provided to ^facilitate the reader; 
in understanding the report n?f the results which follows. ' ' . ^ ' 

ij; ^Program Evaluation, Procedures and Instnnaentation * * / ' 

.1. Participants . - \ " • : 

Pretest data record^ in this report was collected on participants in the following 
components • •* ' . 

a. Beglxmliag participants in the Sequential Biology Component. 

b. All participants in the -Seque^^tial Chemistry Componen,t 

c. All participants in the iJnltary CHEMS Cos^i;ent 

d. All participants in the Unitary General Science, Cdmponent ^ 

e. . All participants in the 1971-72 Academic Year Consonant 

Pretest data was collected from the previously mentioned program componehts in 
the following del^ct^d areas (instrgmiit used is shoim in paz^entheses) • 

a. Pfirticipants * science subject matter competency (specific instruments 
wore developed) \ ' - , 

b. The naturfe of the* science classroom and laboratory activities which 
the participants feel shoold be used ^or secondary school science' 

. • instruction (Science ClassrooA ^' Ac tivlties Checklist : -I'eacher Perceptions) 

c. Participants' undetstandlng of science ( Test on Understanding Science) 
. d« Participants* attitud^ toward jn^thematics, science, science teaching^ 
\ and laboratory work ( Semantic Differential Test in Science) 

Post^esti data in the ^a^eas mentioned previously with r/aference to pretesting was 
collectea on those participants who had conrpleted a component. Those participants who 
are still 'in process (e.g. Sequential) will have posttest ^information collected when 
they comnlete the total -program but will also have pre- and posttest inforpiation 
•collected^for each specific sequence. The only SequentX^l Caiponent posttest infor- 
mation reeojpded dn t^s^ report will be related to the 071 Stumer Sequence, 

Basic descriptiveH'in£ottaation about participants and their teaching situation 
was collected prior bo program participation by means of a teacher questionnaire. 
Besides providing ba^ic .descriptive information (age^ sex^ grades taught^ etc,)| 
tills questionnaire provides infonrfation on^the age oif curricular majcerlals used and 
ojjier variables which »)ave bearing oil program Imp-act when viewed olrer "time. 



In|,orination on the operation of the Coiiprehensive Program Components was coire<?ted 
from participants by means of questionnaires. Basic iijf orq;iatlon oil housing, com- 
munication and othel operations-type inf oration was collected. Questionnaires were 
developed to account for specific differences in the operation of components > however, 
much p-f' th^ information^ coll6*«ted , was common to the total program. 

2, Participant^;' Students , I , ' 

' * ■ . / 

* Da^a was cfbllected from participants' students prior to the participant entering 
thfefe.^.y^r'am. This data was collected in^ the following aresrs (instruTPejqt used is 
shown in parentheses). ' /' ^ ^ . 

I < 

^ .a. 'The nature of the science activities which the participants do .use for 
their science instruction. Thi^ Infpriniation will ^Iso be cpllected 
on participant's students in the spring of tt)e year foj-lpwing completion 
of ^ th'e prograp. (Science Classrobm Activities Checklist ; Student 
Perceptions . ) 

Students* attitudes toward science and other science relati^d areas. This 

* information will also haj^ a/follow-up, , as in 2a above"^ ' ( Seinantic Dif- 

ferential Test in ScienceX ' . * , 
♦ . ■ ^ . ^ 

Student data collection in '^reaa such as understanding of science, science subject 
^matter competency, and science process skills are under consideration, bUt have not 
been implemented. - * . ^ ' f * 

All student data is in the. process of b.elng analyzed, but is not recorded 'in 
this report. » * . \ ' • ' , . 

3. Data Analysis* ■ ' > , 

All data was coded, condensed where necessary, ami put on cards for analysis 
by computer. Descriptive inf onnatioft Vas generated using the University of South 
Dakota Cros^-Tabulation Program. Significant differences between participants' pre- 
and post-telt scores were determined using the University of^Soutli Dakot^ t-Test^ for 
Matched Pairs Program. ' ' ^ " 

C. Organization of the Report 

The analysis and discussion of the data which follows will* be presented in three 
sections. These are, in their order of presentation (1) Descriptive Information on 
Participants, (2) Evaluation of Prograjm Objectives, and (3) Program Processes 
Evaluation. A fourth section ?^^ i :esented which provides^^^onnation on ^taff and 
participant rajik ordering* of ptogram <^bjectives. The fifth 'ami final section 
provides a briief summary. ' ^ 

D. Code for Program Components 

l«Sequential Biology Component'^ 
2»Sequ^ntial Chemistry Component 
3«Uoitarx CHEMS Componeilit , 
4*Earth Science Section of the G^meral Science Competent 
5*Physical Science Section of th(t General Sciende Component* 
6«Academic^Year Component 



'I; DESCRIPTIVE INFORMATIOH ON PARTICIPANTS * 

■ ■ - • 1' . , — ^ ■ •■■ •' 

This information Is based on a questionnaire that was se»t to' each teacher 
prior to participation in the Comprehensive Pr^^gram* Th^e program components 
represented l)y participant data are (1) beginning participants in the Summer 
Biology Sequential (n=3) , /^2)" beginning participants in the Summer Chemistry ^ 
Sequential (n=13); O) 'Unitary CHEMS (n«29y, (4) Unitary General Science - Ear£h 
Science Section (n«25) , (5) Unitary Gerferal Scienc;p - Physicial' Science Section 
(n«25), and (6) 1^71-72f AYI (n-20) . * ^ ' 

1; States Represented and Number of Participants Per State 

Figure 1, p. 180 provides information on the areal distribution of part,icipant8 
by state. The data demonstrates that the C6mprehensive Program at the Univej^sity i 
of South Dakot^ is taking a regional fqcus. The ptogram is evolving toward the 
"goal of IQOX regional participation. Note that this data reflects ^some parti- 
cipants who were part of a tpmponent that was riolu-included in our first (1971-72) 
Comprehensive Program proposal (e.g. General Sciehce Institute). The General 
Science Component is an integral part pf fhe Comp'rehensive Proposal for 1972-73. 



,e of Parrticlpants 

The mean age of the participants in the total p^ograa was 32.67 years (S.D.« 
9.38). The range in, age was from 23 years^ to 61.yeaVs,'^ The S^quential and AYI 
QDmRonents had, on, the average, foufi^ev participants (x/r30). Unitary Component 
participants were gene-rally somewhat older (x*r'3^). 

3. Sex of Participants ♦ " 

Eighty percent of tl^ participants \rere males. This percentage held fairly 
'(lonsfant across all component!. ' 

4. Grade Levels at Which"^ Participants Tea^, 

Table 1, p. 181 provide^ information on the grade -levels at which the 
participants in the various program components taught.^ One of the ifiost striking 
cKara(^teristij:8 is the number of pax*ticipants who taught at Spth the "junior high"^ 
and **hfgh school" levels. Over eighty percent of the par.ticipgnts either taught 
full-time/ or have some teaching responsibilities, below grade ^n. 

. ^ : . . ' - \ 

5. Subjects Taught , \ - " . ^ 

Table 2, p, 182 provides infcJrm^tion on'^the subj^t a^j^ea^or combination of 
areas which participants taught. Seventy oercent of th,e participants teach more 
than one subject and appraximately 353! teach in more than two areas. ^ .It -Appears that 
the nature 6f our Comprehensive Program, as- it is evolving, allows for this type 
of diversity^ * . , • ' V * 
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TABLE 1 



Grade Levels at Which Participants Taught 
^ Recorded by Program Component 
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6« . Organizational Structure .of the Participants* School System 

J • ' ... 

The major organizational* structures of the 112 participants* (those who responded) 

home school sysjtems were (1) K-6> 7-8> 9-12 C28Z); '^<2) 4C-8^ 9-12 (23%)^; (3) 
6-8, 9-12 (20X);'and' (4) K-6> 7-9,. l(r-12 (19%). The' organizational atifucture o*f 
th^ school system has significant effects on course, offerings and Instinictioni ^ 
particularity iDa science and mathematics. The Increasing incidence of middle schools 
(e.g. K-5, ,6;-8., 9-:}^) I and the resultant departmentalization for science and 
mathematics instruction at lower grade levels, has definite implications for in- 
service and pre-8tf,rvlce teacher education..^ The proposal for 1972-73 contains cbti- 
ponents directed toward this area of concern. . * • * 
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TABLK.2 



Subject Areas '"Participants Taught Recorded 3y Program Component^ 



Chemistry 
Earth Science 
G^eral Science 
life Science / 
^yslcal Science 



2 



Mathematics 



♦ Biclogy.s^ • 
.Generial. Science & Physics 

General Science & Physics^* 
Chemistry, ^iBiology 

General Science & Physics', , 
Chemistry 

General Sci^nc:^ & Physics^ 
Biology ^ * ' \ 

General Science & .Cheiplstry; 
flathe'^njatics 

.'General SdeQce' Physics, 
Mathematics * 

. General Science & Chemist ry». 
Blq,logy . , ■ . 

< * 

Getlcra^l Science & ChemiBtry 

General Science & Biology ^ ^ 

General Science Mathematics; 
' Other than Science & Math 

* Generic! Science & Other tha» 
'^cieoxe h Math / 

Chemistry & Bfology 

• ' * »» ' ' 

Chemisti^ & Physics • 

Chemistry ^ Math & Other 
Chemistry & Math 
Chemistry & Oth^r^. • 
' Physics &.>lath*& Other 
'Physics & Other* , 



0. 
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' 2. 
2 
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Total 



3 . 



13 



29 



23 



-2.5 , 



20 



113 



* Tables 5 and 7 are not completely consistent due to the natUre of -the responses the 

tables r^redent. ' ' , • 

** See 'Jode Sheet, *^ 



lERlC 



1. Years pf Teaching Experience K-College 



< 



Twenty percent of the participants had .teaching experience at the elementary , 
sthool ;evel (gwdea K-6). The mean manljer of y^r$ that these people had tau^t 
at the elementary school level was 6.36 years (S.D. 4.72). - ^ - 

Ninety-eight percent of the participants, had^ljicperience at the secoxidarV school 
level (grades- 7-12) . The mean number of years of experience at *the' secondary school 
level recorded by pjogram component is provided In Table 3. 



/ 



TABLE 3-1 

Participants' Means^ean of Secondary School Teaching Experience 
. ' * Recorded By Program Cbmpoixent^ 




. 2 
(n-13) 



S.D. 



X 



Program Component ' 



w 3 4 
(n-29) (n-25) 

z\ 

x: S.D.. X 



5 

(n-25) 



6 . 
(n-20) 



S.D. 



S.D. 



' Tot{il 
xj^ .S.D. 



I — z 

Years. 



5.00 



1.41 



. 3.77 



1.^53 



6.79 



7.17 5.02 



8.35 



6.81 



4.50 



l.,44 



6.40 



Nln^cy-el^c pelcenc of Che parti clpann^ ^ad not had experlei\ce teaching 
at the college level. ' • ,\. 

8. Attitude Participauts. Toward Teaching Science. , , ' ' 

Participants rated how they felt aboKt, teaching science ixa. a flve^polnt scale 
(like 5 to ^ dislike). Table 4 provides the iDean rating of p^^rti^cipants as, to how 
phey feel iibout teaching science. ' . ' 

' " ' " •• ^ \\- , 

TABLE 4 • . , . ' - 

Particit>ants' M6an Rating of /Their Attitude Toward Teaching .Scljince 



Recorded By Program Component 
Program Component 



\1 

(n-i) 



2 

(n-13) 



3 ; 
(n-29) 



4 

(n-25) 



5 

(n-25) 



"6 

(n-20) 



Total 
(n-115) 



X S.D. y S.D. 'X 



S.D. 



S.D. 



■S.D. 



. S.D. . xV S.D.' 



ttitu'de Rating 
like 5»-4.,3, 
2,1 dislike) w 



o-.o 



4.92 



0.27 



4.90 



0.30 1.4.80 
7 — 



0.40 



4.67 



0.47 



4.60 



o!69 



T— 



4.76 



6.47 



1 
I 



.8 

Participants* in all components reflect a very pqsitive attitude toward' teaching 
scienc^. This is further supported by thfe findings reported in the section Evaluation 
oT Program Objectives. ^ \ • / 



9. Attitudes of participants Toward Students They Teach (like 5 to 1 dislike) 



I The general attitude of the participants toward the students which they teach 
was aissessed. They were asked to^ respond how 'ihey felt (scale * indicated above) 
J V toward the students in each class (period) vhich they taught, The participants' 
feelings toward the students in all their classfes wete sunmed and a mean attitude 
toward students was derived, 

■ ^ 

\ ' ^ ' 0 TABLE 5 ' ' V 
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* 
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(li 

T 
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I 



Participants* Attitude Toward Their Students 

Recorded by Program Components ^ ^ 

Program Components / ^ / 

1 2 3 4 ' '5' 6-^ 

.(n-3) (n-13)". (n-29) (n-25) ■ (n-25) (n-l5) 



total 
(n-20) 



X S.D. X S.^.' X S.D. X S.D. x S.D. x S.D. x S.D. 



__:itude Rating 
(11^ 5 to 1 digllke) 



4.17' 



.24 



4.26 



.45 



4.39 



.62 



4.41 



.52' 



4.43 



.48 



4.14 



.52 



4.34 



.54 



Table ,5 provides information' on the. attitude of participants toward the students 
which they tangnt. The participants in all t^ component^ had a positive attitude 
coward bheir students^ Iher^ were. 22 participants who expressed an attitude value of 
less than fou^ap the^five point scale. Only one participant expressed an attitude , 
yalue of less than three. ■ - 

10, P.aijticipants 'Attitudes Toward the Textbook Materials "They Were Using 
(like 5 to 1 dislike) ' . ' 

TABLE 6 ' 

* Pj^rticipants* Attitudes Toward the Textbook Mateirials They Used 
* • In Their Teaching Recorded by Content Area 

• ^ . ' - .Cqntent^rea 

* . \ 

Chemistry Earth. General Physical Physics Math' Biology 

Science Science S^iieitce 
^ . '(0-39) (n-19) (n-36) .(n«33) (n-15) (n-20) (n-23)' 



' — ^ — r 

Attitudes Toward / 
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' Textbook Materials 


3.95 


3.^21 ! 3.47 


3.55 I 3.67 


3.30 . 


3.65 


. (like 5 to( L-dislike) 
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' 1 
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Ierjc 



ii 
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As indicated in Table 6, the participant^^held a moderately positive view of 
the materials they Iked for their teacfiing. Earth Science^ General Science and 
ilathematics materials holJ the lowest ratinns. This raiy be due to ^ somewhat 
lesser degree of emphasis on the intp lamentation of newer curriculum project materials 
in these subject areaa, as compared to biology^*' chenH,s try and physics. 

11, Textbook Materials Used by Participants ' 

Participants Were asked to^ record the textbook materials tl;iey wete using. 

I' 'rhese textbook materials have been tabulated. Only, the most frequent textbooks 
reported will b^e atpached to this report. A -tabulation of all booi;s being used has 
«been^ compiled. This will be up-dated with information from subsequent participants.. 



I 
I 



The most , frequent textbooks used by participants are tabulated by subject area 



in Table 7. 



||ubject 

Biology 



I 
I 

i 
I 

K 
1 



arth Science 



. Physical Sci'ence 



I 
f 
I 
I 



hysics 



• TABLi; 7 . * * 

•Tabulation of Text*ook Title Frequency by Subject 

. Title 

BSC'S (Green) 1963 & 1970 ' . 

BSCS (blue) 1968 

BSCS (yellow) ^ ^ 

,Otto> Towle - Modem Biology^ i965 
Green> Smallwood - Biology, 1968 * > . 

Total Teachers Reporting ^ ^ 

Ramsey, Buekeley et. al, - Modem Earth Science, 1965 
McCraken, Delher et, al, - Basic ^larth Science, 1964* 
ESCP \ ' ' ^ ' 

Total Teachers Reporting . ' 

Metcalfe^^ Williams, Castka - ^fodem Chemistry, .1962 & 1966 
Smoot, Price, Barret • Chemistry-A Moder^i Approach^ 1968* 
Total Teachers Reporting ^ 

Blanc, Fisher, & Gardner Modem Science, ^ 1967 \ 

Brandweinv Stallberg, Bufnett - Life Its' Forms & Changes, 1968 

Total Xe^chers Reporting 

Introductory Physical Science Group^ 1967 

Brooks, Tracy, et, al..- Modern Physical Sciertce, 1966 • 

Total Teachfers Reporting ' • . ' 

Dull, MetcaJLfe,' Williams"- Modern Physics, 1964, X968' 
Dull, Metcalfe^ WillUms, Modern Rhysics, 1960, 1963 
Harvard Project Physics ' * ' . 

Physical Science Sfcudy' Committee (PSSC) 
Total Teachers 'Reporting " ^ ' ^ l ^ 



12. Publication Date of the Textbooks Used by Participants 



hemistry 



neral Science 



Frequ«ncy 

8 
4 

,1 
6 
2 

• 36 - 

4 

3 

'I 

. 15 ' 
6 
45 

6 

. 3 
.42 

12 
10 
41 

9 

.1 

23!' 



The approximate mean pujjlicatlotf date c the tfextbook mrfteriiaila^^ being us^d by ^'ar* 
r rt-lclpfknta fortheir t»eachit^g' was. 1966. the. mode was at 1966^ alo.o. n>«ro wer- ^at-rUXa 
|£|^(^-elng'u8ed, however, that.were published .In^ the lat« and <.n6 



particip^^nt was 
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using tnaterlals published in* 1953. . * » , • 

I3-. bo' Participants ' Classroom Activities Include Laboratory Vork? 

Eighty ^ve i^rcent 6f tHe parti<:ipants fndiVatTed that their studen%« were 
prov^^ded with the dpportunity to be' Involved in laboratory activities. ^ . 

• . 14. Amount of. Time Provided For Laboratory Activities . * / ' , , 

* • ' • • , t * t 

1 • ■ ^ * 

The mean time that participants spent in the science laboratory p^r class per 
week was approximately 56 minutes.* This would be thf equivalent of aboiit one class 
period per week. Further inspection of the data shows ^t hat the time allocate to 
.wo4rK in th|B laboratory is not consistent across all grade levels and subject matter 
areas.. . * \ ■ u * - 

^ ' ' ; . . ^ ' • , - 

/ .Those science co.urses that wercj taught primarily at the 7th to 9th gr«de levelf 
spent less time in thq^ laboratory per week than did those tau^t primarily in grades 
10 and up. Wh^er gr^ide le^el or 8d>ject ta^t ia, the significant variable is not 
determined. Pvarticipants spent approximately 30 minutes per|class per week tg * ' 
doing laboratory work .with their general science students. Physical sciimce classes 
were notad as;^spending approximately ^0 minutes per class per week (pai*ticlpants 
using IPS were found to spend approxitoa'tely 120 minutes per claiss per;week).^ Life 
science .and *earth -science courses were^ found to invplye }.aboratory work about. 30 
minutes per glass per week. * ^ " ' -fu , 

* • ' • *" ' ' 

Science courses taught in grades 10 <yr above spent mpre time in the laboratory 
than those ta^ught at lower grade levjfeld. Participants teaching biology indicated thty 
spent about 65 minutes per class per week in the laboratory. Chemistry and physiqt 
courses were found to involve laboratory work about 70 minutes per class per we<5k.' 

Inspection^of the data indicated that there mi^r be a negative correlation between 
the number of different preparations which a teapher .has per day and the ainount of . 
time his students spend in the laboratory. This and other points will be pursued in 
subafequent analyses. " . ^ ^ ' 

15. Participants* Rating ^of Their Laboratory Facilities (5 excellent to 1 non- . 
existent) 

* . • 
The mean participant rating for their school^s laboratory ufacll it ies waa 3.50 
(1^.0. 1.23). General Science participants and AYt Biology participants rated their 
schools* science facilitiefl somewhat l^wer tlian participants from other components. It 
may be true that if participants begin to use the laboratory more, their feelings 
toward the 'adequacy of their present facilities will be less positive. J 

16. Participants* -Rating of Their^Lalioratory Equipment and Materials y 

(5 excellent to 1 non-existent)^ ^ . ' 

The mean .participant ratip o/^ their schools* laboratory equipment and materials 
was 3.52 (S.D. 1.04). The General Science participants and AYI Biology participants 
rated their schools* science equipment and, materials .somewhat lower than dldjjar- 
ticipants in *other compotJints. If participants begin to use tl*s laboratory more, 
their feelings toward tha adequacy of their fequipment and materials may change. , 
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17. 'i^o Participanjb' Students Use A Laboratory Guide' 



4 » 

Approximately 67Z of the participants responded' that their students do use a 
laboratory guidft.. The average publication date for laboratory guides used- by par-/ 
ticipantsl^ students i^as 1966. This fact, plus a. scanning -of the titles* leads on? ^ 
to conclude that the teachers are using Id^oretory guiHes which accompany their text- 
-bo6ks. *^ ^ - • 
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11. EVALUATION OP PROGRAM OBJECTIVEf.. / . ' v 

Analysis and Discussion of the DatA^^ > * • - ' 

The analysis and discussion will be carried on with reference to the particular 
area which is being evkluatedl 

Af, Subject Matter Conipetenqy , * . • ^ : . • 

* ' • *^ 

, The assessnent of .participants **4evelopinenj; 1^ subject natter cbmpetm^cy will be 
presented under the heading of each program component. This is done because specific 
instruments were generally used for leach individual con^Qent^due to the«needs of 
the participants and the nature of the subject matter being studied, The^instrumeats 
used were generally ^velope^I by the Coiaponent Directors and t^helr staff. The instru- 
ments are directed tpwar^ assessing tl^e major subject matter coo^i^itenclea which teachers 
should hkve in order to teach the. subject or subjects, being emphasized in the pro** 
gram component. The instruments were administered. on a pre and ^oit* component , basis, 

. , • - ^ ' Code for Program Component 

1 " Sequential Biology Coo^onent 

2 « Sequtotial Chemistry Component- 

3 - Unitary CHEMS Compontot - • * 

4 -Earth Science Section of thr General Science Component 

5 > P}iysical^ Science Section of the General Science « Component 

6 > Academic Year Component ^ , * 

1, Blologjy Sequential Component and Academic y%fkv Component (Biology Section) 

' ' » ' . ' • ' _ • 

The subject matter competency of the ^iBM:M^^^pantB ent^rlti^ the Biology 
Sequential Component and the participant^ Injthe^&iology Section of-thi AYI Com- 
ponent were assessed on a pretest^ basis, using a graduate exan^, develqped ,by the U,S,D, 
Biology Department, The exam consists of 125 Ltvssm divided in the following sub«* 
scales (A) Animal Anatomy and .Developmc&it« (B) P] ant Morphology and Ahttomy, (C) 
Geneves, (D) Cell Physiology, (E) Ecologjr and (r) General, 'Biology. 

Table 8 provides pretest data for the two program componfntiU Post test data 
will be collected as participants complete thelt\espective programs. With the com* 
pletlon of posttest data, analysis will be madeUo dftermlne participant gains In 
subject-matter competency. Individual participaht*s pretest scores are also used 
in determining frees o^f weakness and strength so that course\work can ^e prescribed. 

Subject matter competency examinations are presently being developed to assess 
the subject matjjer competencies being developed. durlijg*sj>ecifl0 -sequences of the 
Biology Sequential Component, The first of these will be used t^o atfsess ^he 1972 
/ Sumner sequence,* ^ ' * » f i ^ 

2, Chemistry Sequential and Academic Year Component (Chemistry Section) 

Tt)e itibject matter competency of the new participants en^Uerlng the Chemistry 
Sequential Component and the participants in the ChemTstry Section of the AYI , 
Component were assessed on a pretest basis using a broad chemistry subject matter 
exam developed by the Director of the Summer Soquentlal, The data from thlfl^ exam is 
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i bediig analyzed at the present ciiae, • With t]\^ conpletion of posttest data, analyses 
. will be made to deterniine participants' gaiii^ in subject natter con!petency. * 



* f A3LL 8 

* 

Pretest Means and 'Standard D'svf^ations -or Subscales and 
Composite Scores on the USD Graduate Biology Examination 



Biplogy Sequential^ Biology AYl 
Participants Participants 
(n-3) • ' (n-10) , 



Total 
(n-13) 



1 


1 


S.D. 


X 


S.,D. 


X 


S.l).. 


» ; 

Animal Anatomyl 
1 and Development 
(20 possible) 


14.33 ' 


0.47 


12.70 


2.33 ■ 


13.08 


■ 1> 

2.16 


1 Plant Morphology 
and Anatomy 
(20 possible) 


13.33 


1.25 . 

* 


1 

10.70 

■ 


2.53 • 


♦ ' 

11.31 

j 


2.5$' ' 


Genetlcff i 
(20* poMible) 


11.33 


, 0.47 


11.60 


1.96' ^ 




1.74. . 


Ce^il Physiology 
(20 posspie). 


14.33 


• i-;25 


12. 30. 


1.42 


12.77 


1.62 


Ecology 

(2Q possible) 


7.33 


1.25 


• 8.20- 


;1.99 


B.OP 


1.88 


General Biology 
(25 possible) 


17.33 


1.25 


15.90 


-i.81 


f 

|i6.23 


1.80 


.Composite 
(125 possible) 

^ '4i T r^^ 


18,00 


0.82 


71.40 


6.93 


72.92 


. 6.70 



a) 1971 ^Summer J^quence* " • 

The''1971 ^^^mxakr Sequence of the Chemistry Sequential waa directed at developing 
subject matter'vc^etencies in the areas of electricity and magnetism,^ Inorgaxllc 
chemistry, and dtglfnic chemistry • jtxitse were the mjor empliaaes/ but not all 
participants were n^esdarily involved in all three areas. Instnmants w^re developed 
for assessing subject-matter competencies in each pf these three areas and a^pilrt- 
Istered on a. pre^and posttest basis. Information dealing wifh the inorganic chemistry 
area will npt be "presented 'due to problems in the collection of the" data. / 
( ' 

. Ifblc 9 provides iafo"?!Datiqa wtilth shows that the Sumner Sequential participants 
had a low level of subject matter competency In -the area of electricity and magnetism 
at the beginning o/ the sunmer. At the completion of the 1971 Summer Sequence their 
subject matter co&petency in the area wari significantly (p< .001) greater. 



I ^ \ 
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Me«n», StamUrd DevUtloai, and t-Test For Matched Samples 0otoparlag 
Elect^ricity and Magnetism Pre- and Post test Score?[ 



Chemistry Sequential Participants 



'Pretest 



Posttest 



Pretast-Posttest 





(n-13) 




(n-13) 






i 


X 


S.D. 




X 


S.D. 




t 


Electricity %nd Magnetism 
Examination (possible score 72) 


2.60 


1.28 




43.50 


13.91 


8.71* 


Degrees of Freedom 








r 
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*t3t*A.32 to be significant at the .001 level 

' TABLE 10 

Means, Standard Deviations and t-Teat for Matched Samples Comparing 
ACS Brief Organic Test Pre- and Posttest Scores 



Chemistry Sequential Participant 
Pretest . Posttest Pretest-Poettest 

(n-35) (n-32) ^ 



X" 


S.D. ' 


X ' 


. S.D, 


t 


18,29 


9.14- 

1 


38.81 


9.12' 


.■25.21*('' 










30** 



^Test Scores 
Degrees of Freedom 
*t> 3.65 to be significant at the ,001 level ^ ■ • 

tabl^^ 10 provides information vrhich shows that the Summer Sequential participants 
here were some people assessed who were not pa^t of the Summer Sequential ^omponenC) 
scored significantly hi^er (p< ,001) on the posttest ACS Brief Organic Test than they 
had on the pret^ii^t* . * ■ 

i • ♦ Based on the information available it in reasonable to assume that the 1971 
Summer b^qtxence resulted in Summer Sequential Consonant participants gaining' 
/3ignifi<;antly greatet subject patter coj||etency ii? the selected science areas em- 
phiisited. ' y * 

* > 

'^^^•The n i«ed for calculating the degrees of freedom was equal to the number 6f matched 
pairs, ^Consequently, It wtll not always he the same as the posttest n. This 
will be true for some other tables in this report, but an explanation will not be 
provided,. » - 
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3. CHEMS Component 



The CHEMS Component \was directed at developing the chetaiatry subject-matter 
competencies necessary, for parUcipants to teach QHEMS Chemistry, Emphasis was also 
placed on fanjiliarity with CHEMS curricular -nate rials > particularly with reference 
to laboratory activities. 

The subject matter competency of the CHTMS .participants was assessed on a pre-, 
and^ppst- partici'pation basis using the 1968 version of The Americ^ya Chemical Society - 
Advanced High Sphool Chemistry Test. Table '11 provides information which shows that 
the CHEMS participants initially had a low l^evel of competency in the general areas ^ 
of chemistry measured by the test, A coiDparison of pre- and posttest scores (Table 11)' 
shows that the participants had gained significantly *(p< ,001) in general chemistry 
subject matter^ competency by the completion of the CHD1S Component. 

TABLE 11 ' ... 

MeanSi Standard Deviations, and t-Test for Matched Samples Comparing 
ACS Advanced Hi^ School Chemistry Test SV:ores 



Pretest 
(n-29) 



casts Parti^pants 
Posttestt 



Pretest-Posttei't 



Test^.Scores 
(80 possible) 

Degrees of Freedom 



X 


S.D. 


X 


SlD. 




, ii.15 




26.48 


9.75. 


9.68* 


- / 


' J 






ft 


26 



.-*t>3^7l to be significant at the ^001 level 

Based on t^he information available It is reasonable to ^£er thst (he CHl^ 
Component resulted 1^ participants gaining significantly greater subject matter 
competency in the at^a of general chemistry* 

4« • General Science Component 

The General Science Co^onent was cofiq>o3ed'of 50 participants of vKlch 25 
worked with Eatth Science Curriculum Project (ESCP) materials and 25 workcdf with 
Introductpry Physical Science (IPS) curricular materials. There was a comnon 
mathematics component directed at provl,^ting the mathematics prgficiency needed 
for working with either set of curricular toiterlals, " 
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TABLE 12 

Means, Standard Deviations and t-Test for Matched Samplies Coopiarlng 
USD General Mathematics Tt.'i-t, Pre- and Post test Scores ^ 



Pretest 

(n-25) 



Earth Science Participant? 

Posttest 
(n-24) . 



Pretest-PoAttest 





X 


S.D. 




S.D. 


. t 

t 


Teat Scores 
(150 possible)^ 


87.76 


27.14 


\ 113. 33 


18.76 


8.03* 


Degrees of Freedom 


* 
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*t> 3.77 to be sigaificant at the .001 level* 



A genertl mathematics test was developed which assessed tlie desired mathematics co^ 
pecencies necessary for teachers who would teach the curricular ^terials eaphasisad In 
the General Science Component. Table 12 shows that the Earth Scx^ce participants had 
a significantly gj^^at;er (p<.(T01) general mathematics competency at ^e completion of 
the General Science Component, thati they had when they began. 



TABLE 13 



'Mltfns, Standard .Deviations and t-Tert for Matched Samples Com(>aring 

f - - - . - - • 

V 



USD General Mathematics Test Pre* and Posttest Scores 

Physical Science Participants 

Pretast**Poattest 



Vrttest 

(n-25) 



Posttest 
(n-25) 





X 


SJ). 


X 


S.D. 

^ * * 


t 


Test Scores 
(150 possible) 


106. AO 


27.30 


135^20 


19.27 ' 


4.33* 


Degree^ of Freedom . 






. •> 


* 


24 ■ 
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*t>3»7A to be significant at the .001 level 

Table 13 shows that the Phvsical Science participants had gained significantly 
(p<t001) in general mathematiVs* competency by the coopletion of the General Science 
Component. . . . ' 

The Physical ScitQce participants bfgan the program with a greater mathematics^ 
competency than the fiarth Science participants. (Compare pretest mean Tables 12 and 
13.) Based on the differences between tne two groups on the pretest it may b^ 
reasonable to modify the General Science .Cotriponent and of f» a separate mathematics 
course for each group. Another alternative would be to offet two mathematics courses 
and place the participants in the courses based on their mathematics competency 
pretest scores* vf ' 

S Q ' 



\ 
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>ubjei:t 



a) Eardi Science and Physical! Science >ubjett Matte^ Competency 

The Earth Science Concepts and Processes Test was d^velooed under the direction 
of Dr. Victor Majrer at the Ohio State University for use with his NSP institute group. 
Permission was obtained to use this test Wit^. the^Earth Science Section of the 
General Sciience Component;. ' \ ' • . 



TABLE 14 



Means, ^Standard "Deviatlbns and t-Test for Matched Samples Comparing 
Earth ^Science Concepts an<J Processes Pre- and Posttept Scores 



Earth Science Participants 



PreTest 
(n-25; 



Ejpsttest 
(n«23> 



Pr etes t-Pos 1 1 es t 



Test S^cores 
(40 possible) 



X 


S.D. . . X 


S.D. 


' ' t 


Z9.64 


1 ' 

5.01 ' 31.65 


4.38 ' * ■ 


2.97* 




22 



Degrees of Freedom 

*t>'2.82 to be significant at the .01 level ^ \ 

^ Table 14 provides Information^ which shows that Earth Science participants had 
significantly greater (p<.01} subject matter competency in earth science at the 
end of the .summer program than they 4iad at t;he beginning. This two point gain may 
not represent the act^ual achievements The test' used is being analys^ed for possible 
modlflcatibns. ' . * 

X ■ ■ • 

1^ The information provided in Table 15 shows that the Physical Science participants 
had significantly greater (p<.00l) subject matter competency at the end of the ^ 
summer program than they did at the beginning. The celling on t*^ls tTest was too J.ow, 
consequently » the three point gain is probably not a true; measure of achievement. 

Based on the information available it is reasonable to infer that the General 
Science component resulted in participants gaining significantly greater subject 
matter competencies in geperal mathematics and the science areas studied. , 

' . • ' TABLE' 15 " ■ ^ . 



V 



Me«is 



Test Score^ 
(22 possible) 



Standard Deviations and t-Test for Matched Samples Comparing 
Physical Science Test Pre- and Posttest Scores 



Pr«.t;est 
(n-25) 



S.D. 



16.56 



3.42 



Degrees of Freedom - . 
O .t^ 3.7A to be slgqificant at" the .001 leve] 



Post teat 
(n-25) , 



S»D. 



19'-.56 



2.47 



Pretest-Post teit 



5.33* 



--i 



24 
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Instructional Activities , Which Participants 
They Do Use For Iheir Instruction 



Jleel 



Should Be Used an4 Those 



1. Classroom aiid labpr;ato^ry a ct i v ities which participants feel should be 
• used for science instruction. 



Spach participant responded to. the ^cience ^ Classroo^i Activities CheclflM.st^ * 
T6,adier Perceptions i(SCACL:TP) pre- and post' program participation. "Hiis instru- 
ment is directed at det^rml^ning the nature of the science classroom and laboratory ^ 
actitf^t*les which the teacher Te^els "should'' be used for 'secondax^ school science 
inst:ruG;t,ilQn. The checklist is scored according to whether the teachers' responses 
are correct in terms of the nature of . the activities Which are thought to. best 
implement the overall pbjectives .of sclenc,^ education. The SCACLrTP is divided 
into seven subscales which are (A) Student Classroom Participa.tion, X®) Role pf 
,the Teacher in the Classroom, (C) Use of Textbook and Reference Materials, ' , 

(D) Design and Use of Tests, CE) L^ibpratory Preparation, (F) Types o*f Laboratory 
Activities, and (G) Laboratory -Follow-up Activities. 



T^ble 16 provides SCACLfTP pre- and posttest meems and standard deviations for 
each component and for the total program. Posttest data will be collected on all 
the other ^mponents as* the participants complete them. ^ \ ' 

Table 17 provides information which shows that the CHEMS participants •\cACL:TP 
posttest mfi.an_£omposite *score w/is not significantly different from their meati 
pretest score. CHEMS participants* scores on Subscale F (^Pes of Laboratory \ 
Activities) did show a significant change from pre to post (p^.05).* The chang^ 
was towam the direction of lower .scores on the Subscale and wot^ld indicate that 
participants felt laboratory activities Should' be more structured, and 
The CHEMS {>articipants , however, entere^J the program in relatively^>^ 
with educators as to thf. types of activities which should be used fo 
scienter education activi4pi:e»)^and in general, they maintained this agi^ 
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\ TABLE 16 • 



Pre-, and Posttest Means and Standard Deviations For Subscales, 
artd Composite Scores on the SCACL:TP' By Separate<*#rograra 
Components Wd Total Program ' 

.1 ,2- 3 4.|5 6 7. Total 

' (n-3) (n-13) (n-29) (rif25) (n-24) ' ' (n-lO) (n-l6) (n-114) 



X S.D. X S.l5. , X S.D. , X \SI.D. h S.D. 



SCB;L:TP 

SuWest A ' 
Priest 8* 

Subtest A '{ 
Politest 8 

Subtest B 
Prftest 9 




ret I 

ost 
5^ 



Suites t C 

Posttest 8 



est D 
Pretest 11 

^uPiest D 

Fn£<test 11 

^uKest E 
>rW:e6t 8 

Sy«:e9t\ 
PoBrtest ff^ 



Sujifest^F 
Prftest 9 

Suhtest F 
PcKtest ,9 

Subtest G 
PxAest 7 

Subtest G 
PcjU^test 7. 

Composite 
Finest 60 

ost 

If 



CdHl^osite 
"osttest 60 



3.00 0.00 
I**. I 



9.00 0.00 



6.69 1.07 



^3 o;94 



10.00 0.82 



8.23 0.89 
I I 

■sJ ■ 
,6.85 0.95. 

\ 

.1 ■'<L 
,9.85 1.03 



6.33 0.47 



8.00 0.82 



I- I 



6.62 1.50 



6.33 0.94 



55.00 3.56 



8.00 1.04 
I ' I • 
6.08 0.73 



52.31 4.05 



I . I 



7.45 0.67 



.08 1.04^ 



7.33 0.85 




X S.D4 

• 


X S.D. 


, 6.70 1.10 


7.00 0.77 


. I I 


I . I 


7*90 0.70 


8.20 0.75 


I I 


■ I I 


6.80 0.87 


6.20 0.87 


.1 I ' 


I I 


9.^0 1.40 


10.10 0.94 


I I 


■1 1 

't 


* 

6.40 0.80 


7.20 0.75 


I I 


I I 


7.20 1.60 


8.20 0.ft7 


I I 


I I 


6.40 0.82 


6^96 0.3a 


I I 


I. I 


50.60,4.90 


54.80 2.75 


I I 


I I 



X S.D. 

7.08 0.94 
7.25 0.95 
8.05 1.05 
8.1^0 0.87 

« 

7.03 1.00 
7.25 0.9^' 
9.51 ^.29 
9.43'. 1.22' . 

6.63 1.15 
6.84 1.17 

7.64 1.21 
7.58 1.41 
6.36 0.76 
6.55 0.74. 

52.29 '4.80 
53.12 5.00 



l ERJC * NiimhAr' no<»s^h^« ** The DOsttRst has not been' administered 



TABLE 17 

4 ' 1 



t-Test for Matchefil^ Samples Comparli;g Science Classroom Activities 
Checklist:' Teacher Perceptions Pre- and Posttest ^Scores 



t Subscale A 

t Subscale B 

t Subscale C 

t SubQcale D 

t^. Sjibscale E 

t Subscale F 

t Sul^scal^G 

t Composite 

Degrees of Freedom 



Component 
* 3 


Component ^ 


Component 
. > 5 


-1 OA ! 


' 0.65 


1.10 * 




0.75 


• 2.33** 


0 00 / 


0.00 


2.35** 


-1 61- 


1.00 


0v66 






0 on 


-?.09* 


\ 0.89 


1.60 


0.53 


\ -2.08** 


0.40 


-1.13 , 


\ 2 .72** \ ^ 


1.80 


28 


\ 22 






*£> 2.0*5 to be s*gnificant at the .05 le^el 
**t5'2.07 to be- si'gnif icanrt at the .05 level 

Earth Science Section of the General Science ptnpc^nent did demo^ns^rate signi- 
ficant change (p<.Oi^ in their views of the classroom activities which shpuld be uscfd 
for science instruction (Table 17). The change was tdward higher scor^^. An analysis 
of the subscales.^revealed that most of the change was in Subscale E (Laboratory Pre- 
paration) and Subsiale G (Laboratory Follow-up Activities). The scores indicate a ' 
change on the part of the participants toward more open investigatory tyiJ.es of laboratory 
activities and follow-up. ^ \ 

^ Table 17 provides- information which shows that the Physical Science participants' 
(General Science Component) SCACLjTP post test mean composite scores were nOt signi- 
ficantly different from their mean pretest composite scores. Subscale analyses reveals, 
however, that they did demonstrate (Table 17) significant pre-posttest changes on 
Subscale B (Role of the Teacher in the Classroom) and C (Use of Textbook and Reference 
Materials). The scores reflect a change on the part of the participants toward a class- 
-room with toore student participation, less teacher domination, and one in which the 
students are encouraged to go beyond their textbooks in seeking information. ^ 

Inspection of Table 16 leads to the conclusion that all of the participant^ entered 
. the program in generally good agreement with science educators as to the type of class- 
room and laboratory activities which should be used for science instruction. The pro- 
gram components contributed positively in several areas toward strengthening this agreeman 

2. Classroom and Laboratory Activities Which Participants Do Use For Their 

/ Science Instruction * . ' 

* The types of/ classroom and laboratory activities which the Comprehensive Prograc\ p^rtl. 
cipants do use far alienee instruction .was assessed using the Science Classroom Activities 
Checkl-st: Student Perceptions (SCACLtSP). The SCACLtSP is a parallel instrument to'the 
SCACLtTP discusse\jpreviously. The nature of the activities the student perceived the\r 
J tachers'to use was assessedvprevious to thoir teacjiers* participation in the Coraprehenddv 



I 
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I 
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Program^ aod will be assessed again after -program participation. The pre-program 
scores are being tabulated at the present time, 

C. Und^rstandttig of Science • * • 



Each participant responded to the Test on Understanding Science (TOUS), both 
pirevious to program part^icipatjon an^ at the completion of the program. ,The 
TOUS test is divided into three sut scales which are (1) The Scientific Enterprise, 
(2) The Scientist ancl (3) Methods an<} Aims of Science. 

Tajble JL8 provides TOUS pretest and posttest nea^ and stan^lard deviations for 
each component and for the total program. 

TABLE 18 ^ 



. , . L 



Pre- and Posttest Means and Standard Deviations for the^^ 
(TOUS by Separate Program Components and Total Progr^ 

5 3 4 5 '6 



(n-3) 
x' S.D. 
TflBS Subscale 1 
.Potest XS.hl 1.25 
TOUS Subscale 1 ,. 
pjttgst I* I- 



TOUS Subscale 2 
plltest ' 13.33 ]\.25 
T|JS Subscale 2 
Posttest . I . 

«S Sub3A»l«'3 

Pretest 15.00 2.94 
ijj's^bscale 3 

I 

I J test A2.00 ^.55 
JS Composite** 

1 



Posttest ' I 



JS^i'Composite** 



iHttCSt 



(;i-i3) ' 


(n-29) 


(n- 


25) 


(n-25) 


(n-10) 


(n-lO) 


X S.D. 


X S.D. 


X 


S.D. 


X S.D. 


X 


S.D. 1 


X ' 


S.D. 


^3.85 Ip^ 


13.90 1.7? 


12.52 
■* 


2.45 


13.36 2.41 


13.*20 


1.60 


14.00 


1.48 


I I 

• 


14.2^8 1.82 


13.35 


2.33 


13.92 2.10 


.1 


I 


I . 


i • 


12.92 2.09 


12.93 2.03' 


12.44 


i.l6 


11.76 2.5fri 


13.20 


1.17 


14.00 


2.41 


* 
















J 


I- I 


13.17 2-17 


12.65 ^.46 


12'. 80 2.10 

* 


I 


I 


I 


I 


16.92 2.76 


16.10 2.75 


14.20 


3.20 


15.52 2.80 


16.40 


3.07 


• 

17:30' 


/ 

2.83 


\ I I 


16.31 2.60 


14.57 


3.44 


16.40 2.37 


,1 


I. 


I 


I 


42.^2 4.68 


42.55 4.S9 


39.16 


6.62 


40.64 5.76 


42.80 


4.94 


45.30 


5.50 


I \ I 


♦3.76 5.35 


40.5) 


7.11 


43.12 5.6Q 


1 


r- 


I 


I 



Total 



X S.D. 



13.42 2.18 



n.i88 2.10 



1,2, 70' 2.2.5 



UifO 2.25 



15.76 3.07 



15.82' 2.93 



41.69 5.81 



\ 



42.j6n 6.18 



I 

r ^ 



* The posttest' hds not. been administered Possible 60 points 
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The composite mean of the pretest scores for the participants that have completed 
components (CHEMS and General Science) is 40.78.. A comparison of this TOUS mean pretest 
^ score to Table 19 ind^.cates that the participants in these groups, on the average, ranked 
at about the 87th percentile when compared to the 1960 national sample of twelfth grade » 
students, the postrcomponent composite scores for these same groups have a mean* of 
42.60. This indicates tTiat after having completed the program, the participants, on the 
average, ranked at the 93td percentile when conJj^ared ttf the 1960 national sample of 
twelfth grade students. Probably the most meaningful dbpect of this comparison 
is that the particijiants ranked above the >Oth percentile when compared to a natixmal 
sample of twelfti^ grade students. - • ^ 

^ Further study shows that, all components demonstrated gains on thje TOUS when pre- 
copponent and post-component scores are compared. Table 20 provides information which \ 
shows, however, that only the Physical Science section of the General, Science Componen.t ^ | 
showed significant gains (P4..01). * / ;* 

The need for further 'norm^ive data and more study in. this arej^is evident.". 
Whether the teason for lack of significant growth is due to a good underst^inding of • 
science on thp part of participants when they enter the program, or whether we need to 
modify soine components of our program to facilitate growth in this area is not clear 
a.t this point. It is clear, however, that participants in all components are showing 
a somewhat greater .understanding of science measured by this test at the completion of 
tjie program com]?fonents . ^ ' 

TABLE 20 



t-Test For Matched Samples Comparing 
TOUS Pre-' and Posttest , Scores 



/ 

\ 


t .for 
Subscale 1 


t for 
Subscale 2 ^ 


t for 
Subscale 3 


t /o r 
Composite 


Degrees 
Of ■ 
Freedom 


Component 3 


1. 34 


.80 


.38 


1.56. 


28 


Component 4 


1.75' 


.63 • 


.1..08^^ 


.1.60' 


22 


Component 5 ^ 


1.48 


2.01 


2. 24** 


3.40**- 


23 



* t>2.05 \o significant: at the .05 lavel 

** t^2.07 tiD.'be significant at)th^ .05; level" 

Posttest dalk will be collect^ on the o£her cdtnponents as they complete thr^ir 

program. Table Vil provides percentile rantks based on a nationwide sample 
of 3009 public and private school st^rtfentr^tested In October 1960 <thi8 is the 

only normative datva of which the author is" aware)., \ 



23 



TABLE 19 



TENTATIVEl NORMS — Test .on Understanding Sdience (TOUS) 
Percentile Ranks for tiiglf 'School Studental ?^ 



TOUS 
To tar Score 



4.8 
47 

, 46 
• '45^ 
A4 



Grade 9 



42 
41 
40 

■ 39 
.38 
37 
36 

35 ' 

34 

33 

32 

31. 

30 

29 
' 28 

27 • 

26 

25 

24 
. 23 

22 ' 
\ 21 

■ 20 

19. 
, 18 ■ 
17 
16 

15 * 
14 
f 13 



Mean Score 
Standard Deviation 

Nuniber of Students 



99 
98 

97 

94" 

90 

85 

81, 

75 

69 

64 

58 

.52 

45 
38 
32 
27 
22 
17 
12 
10 
9 
7 

6 
4 



29.47 
6.03 

198 



-Grade 10 



99 

98 - 
97 • 
96, 
94. ■■ 
92 

. 91 ■ 
89 
86 
84 

81 - . 

77 

72 

ef 

63 

58 , 

52 

46 ■ 

40 
. 36 

32 

2S 
•2-3 . 

19 

16 

14 

11 
8 
7 
5 
4 
3 
2 

28.58 
7.66 

1064 



Grade 11 



99 
98 

■^^.^.•97 
96 
■'.94 
if*- { ' 92 

. 

' ■> 87-: 



84 
81 
78 
74 
69 
64 
58 
52 
.46 
41 



36 
31 
28 

2;? 

vl8 
15 
.12 
9 



4' 
2 



31.57' 
7.02 

. 994 



Grade 12 

:. 99 

98 ' 
9f> 

95 . ' 
93. ' 
90' 
88 
85 

82 
78 

- 74 

69 , 
63 

59 * 
. 54 

47 
' 41 

: 36 

'32 

28- 
•■ '24 
' 20 . 

16 

14 • 
•12 
9 
. 7 

- * 5 

4 
3 
2 



32.25 
7.38 

753 



L — . ■ ■ ■ " ; ' . ' ' / ' ' ' ' < ■ ■ ■ .1 

TBased on a nationwide sample of 3009 public and private school students tested ih October 19^0. 
tThe means ana standard deviations are basejl or 2980 of the 3009 students: 9th Grade, 198 stu- 
snts; 10th GrWde,- 1055; Jlth, Grad^,- 985; 12th/Grade, 742.)5(|L , . 

figures for Grade 9 should be used with cautJ^cn., aincfe they aije based on a relatively small 
^mple group. \ J . . ' . 

r IS n from TBSTi ON \UNDERSTANDING SCIENCK, ^lanual fot . Adminif^tering, Scoring, and Interpreting 
IERJ[C^> Educational Testihg Seryice, 1961. • ' - / - • . ^ 
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Dt Attitudes of Participants and Theiy Students 

1: Participants . 

Attitudes toward several aspects pf science were and are being assessed usinj; the^ 
Semantic Differential Test in Science developed by Pr. James Gallagher at the Educational 
Research Council of America. This instrument was. developed for use with the Test Every 
Senior Project. The SemantAc Differential Test in science was used in assessing the 
attitudes of Comprehensive Prograiq^ participants both pre-^ and post- pxfbgram and for 
assessing^ the attitudes or the participants* students. 

' The concepts evaluated by teachers and' students were (1) Social Studies, (2) Mathe- 
matics, (3) Science, (A) Science Teachera, (by students);, Science Teaching (by participants), 
(5) Teachers, (6) School, (7) Laboratory Work, (8) Scientists and (9) Myself. * These 
nine concepts were evaluated iri termd of Sixteen bi-polar scales. The bi-polar scales 
were classif,ied into four categories - evaluation, potency, activity, and personality. 
A five point differential Wias used on all'scales. * 
w 

Student and teacher responses to each* of the semantic differential concepts were 
assigned integral values ranging from one nolnt.for the^least favorable response 
(e.g. bad) to five points for the most favorable response (e.g. good). Since e^ch of 
the categories, evaluation, potency, activity, and personality^ was comprised of four 
bi-polar scales, .an average score for each category was determined for each individual.. 
Mean category responses were calculated for all the students of any one teacher. Thus, 
on each concept, «a teacher (participant) and/or his students received four scoras ranging 
from one to five points, one scbre for evaluation, one for potency, one for aotiylty, and 
one for' persoaality. This was, and will be .done on each participant previous to participa- 
tion in the program and ^t the completion of participation, ^roup means were calculatad 
for each Program Component. Follow-up data will also be collected x)n participants and 
their students. • , , - 

For purpose of 'this feporc the four concepts evaluated were (1) MathematdLts , 
(2) ScieiUe, (3) Science Teaching, and (A) Laboratory Work. 

TABLE 21 

Means and Standardj^HDevlations for Semantic Differential Pretest Scores: 
Mathfematics Grouped by Program Component 



Program Components 



1 

(n-3) 



Total 



(n«13) i (n-29) « (n«2A) (n«22) (ji-lO) (n-10) ' (^-111) 



X 




X 


S.D. 


X 


S.D. 


' X 

« 


S.D. 


X 


S.D. 


• H 


S.D. 
< • 




7 S.D. 


• > 

X 


S.D. 


A. 17 


.A7 


A. .36 


.32 


A. 29 


.60 


A.2S^ 

« 


.50' 


A. 36 


.53 


A. 05 


...60 


A.A7 


V36 


A. 31 


.S3 


2.50 


0.0 ^ 

1 

'.A2 


3.31 


.53 


3.3A 


.A7 


3*20 


.'50 


2.95 


.36 


2.85 


.A2 ' 


3.20 


'P. 


^3.15 

• 


.53 


A. 08 


'3.77 




A. 00 


>53 


3.91 




3.57 




3.97 


.38 


A. 00 


.39 




.60 


3.00 


".'35 


3.06 


.36 


'3.1A 


:.3o 


3.^23 


.A7 


.2.95 


^37 


'3.15 


.39 


3.27, 




3.12. 


.AO 






4 




^" , 










•B 










f 
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I ^ / TABLE 22 

Means ^nd Standard Deviations For Semantic Differential Posttest Scores: 
Mathematiofe- Grouped By Pragram Component 



f 



E\B.uat:lon. 
Potency . 
A(||||ivity 
Personality 



1 



Program Components 

5 3*' '* 4 ,5 * j6 

(n-13) • (n-29) ' (r.»24) (n-27) ^-10) 



7 ' Total 
ixi'ioi (n-lll) 



1 


s.L 


X 




X 


S.D. 


X 


S,D. 




S.D. 


X 


S.D. 




ys.D. 


X 


s.d'. 




t / 


I 




4.30 


.60 


4.25 


.58 


4.3^ 


.71 


I 


I 






4.30 


.64 


' I 


/ > 

/i • 


I 

• 


I ' 


3.20 


.55 


3.17 


.40 • 


3.15' 


.47 


> I 


I 


I 


- I 


3.17 


:48 


1 J/ 
1 If 


I 


I 


I 


3.80 


.51 


4.00 


.55 


3.67 


.70 


I 


I 


I 


I 


3.81 


.61 


/ ^ 


I 


I 


I 


3.04 


.21 


3.10 


.51 


3.19 


.6er 


I 


I 


I 


I 


3.11 


' .50 



* I«Progr^ not completed as yet 



Table 23 provides information which indicates that CHEMS participant at tituda^ toward 
mathematics changed significantly (P^.05) in the activity category and approximated a / 
significant change in the pbtency category. Comparison'of Tables 21 tad 22 indicates 
that these changes. v6re toward participants expressing generally lower attitudes toward 
mathematics. Further study will have to be made to determine if supplementary york in 
mathematics is needed as* a part of the CHEMS Component. 

Table 23 /provides Information which indicates no significant change in Earth Science ) 
participants' attitudes toward mathematics at the tompletion of the Gtaejral Science 
Hi Component. Pretest subject matter competency scores indicated that grouping the Earth 
.Science and Physical. Science Sectiond might be' appropriate. The effect tfiis grouping 
inight have on attitudes could be very interesting. 

Physical Scijence i^rticipants had significantly (Pt.OS) changed their attitudes upward 
.Inathematics by tn4 completion of the General Science Component (Table 23). This change 
was significant (P^.05) in three out of four categories. Comparison of Tables 21 and 
22 indicates that these cKanges were toward participants having mcfre positive attitudes 
toward mathematics at the completion of ^he GerieraS Science Component. ' ^ 
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TABLE 23 



t-Tests for Match Pairs Comparing Semantic Differential: 
Mathematics Pre- and Posttest Scores Grouped By Program Component 

Program ^XJomponent 



/ 



• 

^ 1 


. 2 r 


' 3 


4 ' 


5 




6 


7" 






t 


t 


t - 


t ^ 




f t 


t 


Evaluation 


I* 


. I 


0.00 


1 • 

0.22 


2.43*** 


i 


•i 


Potency 




« I 


2.04 


0.24 


•2.32 


r 




1 


Activity 




• I 


2.24 


1.27 


1.66 




I 


I 


Personality 




' I 


, 1.16 


1.31' 


2.58*** 


I 


I, 


Degrees of Freedom 




I ^ 


27** 


» 22**1 


r 23 




•I 


I 



* I « Program not completed as yet 
** t > 2.05 to be significant at the .05 level 
*** t,> 2.06 to be significant at, the .05 level 



b. Science 
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Means and Standard Devlatipns for Semantic Differential Pretest Scpres: 
. , Science Grouped by Program Component ^ , 



Program Components 



1 . 
(n-3) 

: S.D. 



4.83" .12- 

3.60 .41 

3.91 .51 

3.33 .12: 




3 

(n-29) 



^5 .33 
^.38 ..50 
4.07 .51 

3.36 .48 

T*" 



.4.68 .31 
3.53. k55 
4.31 '".42 
3.45 .57 



4 

(n-24> 
: S.D. 



4.67, .42 

3.47 .54 

3:78 • .77. 

3.56 .57 



5 " 
<n»22) 

ic S.D. 



4.74 .28 
3.26 ;.57 
.3.84 .74 

0 

\ 

3.31 .50 



6 

(n-lO) 
: S.D. 



4.75 .35 
3.07 .37 
4.00. .32 
S.57 ■ .45, 

— r — ^ 



7 

(n-10) 
S.D. 



4.72 .26 
3. 35..:, 78 
1.4.45 .46 
3.60 .61 



Total 
(n-111) , 

X S.Di 



4. .71 .33 

3.38 .58 

4.04 .64. 

3.46 ..54 



I 



I 



I 

• * 

lERlC 



) 



• 4^ 



29^ 



'7 



TABLE 25 



Means and Standard Deviations for SeTiantic Differential Posttest Scores: 
Science Grouped by Program Component 



Program Components 



3 



4 

Cn-24) 



iluation 
P^ency 
Aftivity 



X 


S.D. 


X 


S.D. 


X 


S.D. 

1-^ 


X 


sTd. 


X 


S.D. 


X 


/ S.D. 


X 


S.I>. 


X 


S.D." 


I* 


J 


I 


I 


4.65 


.3S. 


4.5f 


.47 


4.68 


.35 


I 


- I 


t 


I 


4.64 


.39 


I 


I 


I 


I- 


3.38 


.59 


S.45 


.49 


3.42- 


.68 


I 


I 


I 


I 


3.42 


,60 


I 


I 


I 


I 


4.06 


/6A 


4.04 


.5.0 


3.99 


.64 


I 


I 


■I 


I 


■ 4.03 

• 


.60 

* 


I 


I 


I 


I 


3.32 


'.49 


3.42 


.58 


3.49 


.70 


I 


I- 


I 


. I 


3.41 


.60 



I 

I 

I 
I 

I 
I 

J 

I 

I 

I 

I 

I 

I 

I 
I 

I 

I 

r 

.J ERJC ^^t >2.a7 to bp sicnlftcant at the .05 levol 



17 



5 

(n-27) 



Total 
(n-80) 



' * I -jPragrao not completed'as y^t 

Table 26 provides information 'which ^^ndicates that all' participants entered the Com- 
prehensive Program with fairly positive attitudes toward science. 

Information provided in Tfifble 26 indicates a significant (P<.05 level) change of 
CHEMS participants* attitudes toward science (activity category) by the completion of 
the Component. Comparison of Tables 2A and 25 reveals generally lower attitude scores 
toward science at the completion of the component. The depression of attitude scores 
however, generally was not significant^. Participants completing the program revealed a 
generally positive attitude toward science, but the indication of decline will be 
scrutinized to see if a problem exists. 

The Earth Science participants .had changed their attitudes significantly (P<t05 level) 
toward science (activity category) by the completion of the component (Table 26). None of 
^he othei* categories ^showed significant change. Cpmi^rl'son of Tables 2A and 25 reveals 
that the change was toward more^ositive attitudes in the activity category. 

The Physical Science participants had not changed their attitudes significantly . 
(Table 26) toward science at the completion of the General Science Component. 

TABLE 26 ' . 

t-Tests For Matched Pairs Coitpdring Semantic Differential: 
Science' Pre- and Posttest Scores 'Grouped by Program. Component 

Program Component 



Evaluation 
Potency 

•Activity 
I 

Personality 
Degrees -of Freedom 



1 


2 


3 




5 ' 


6 




t" 


t 


t 


t 


. t 


t 




I* 


I 


0.35 


0.37 


0.89 


V 




I 


I 


1.56 


0.53 


0.00 












iti 


'it' 






'l • 


; I 


2.32 


2.55 


0.21 






I 




i.:l6 


0.73 


1.17 






I 


. I 


2S** 


22*** 123*** 







Program not completed **t>2.05 to hn f?ip,nificnnt at the .03 love 
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C4 ^lence Teaching 



TABLE 27 



MeaA,8 and Standard Deviations for Semantic Differential Pretest Scores: ' 
Science Teaching Grouped By Program Component 

Program Components 

1 2 3 4 's 6 7*. 

(n-3) (n-13) (n-29); ' (n-24) (n-22) (n-10) (n-10) 



Total 
(n-111) 



1 

Potency 



uatlon 



Lvity 



Personality 

I 
I 
I 
I 

\ctivfty 
?Jlonallty 



X 


s.d/ 




s.d. 


X 


S.D. 


X 


S.D. 


X 


S.D. 


X 


S.D. 


X 


S.D. 


X 


S.D. 


4.17 
*2.92 


s 

.31 


3.46 


.39 
.46 


4.64 
3.35 


.34 


4.48 
3.^4 


.55 
.49 


*4;66 

3.09 


.38 
.33 


4.70 
3.27 


.46 
.58 


4.72 
3.47 


.47 
.50 


4.62 
3.28 


.45 
.48 


4,08 


.31 


4.29 

c 


.41 


4.18 


.65 


.4.02 


.65 


3.94 


.63 


4.27 


.38 


4.40 


.30 


4.14 


.54 


3.67 

1 


.51 


3.79. 


. -64 


3.68 


3.81 


?74 


3.52 


.66 


3.95 


.64 


3.97 


.54 

f 


3.74 


.68 



TABLE 28. 

Means and Standard Deviations for Semantic Differential Posttes't Scores: 
Science Teaching Grouped By Program Component 

Program Components 



3 

(n-29) 



. 4 
(n*24) 



(n^7) 



7 * 



Total 
(n-80) 



Evaluation 
Povncy 



X 


S.D. 


X 


S.D. 


X 


S.D. 


X 


S.D. 


X 


S.D. 


X 


S.D. 


X 


S.D. 


X 


S.D. 


. I* 


I . 


■ i/ 


I 


4.65 


.53 


4.66 


.43 


4.63 


.48. 


I 


I 


I 


-I 


4.64 


,48 


I 


I 


I 


I 


3.30 


.47 


3.33 


.55 


3.22 


.62 


'I 


I 


I 


I 


^28 


.55 


I 

C 


1 


• I 


I 


4.19 


.58 


4.08 


.51 


4.09 


.50 


'I 


I 


I 


I 


4.^ 

* 


.53 


i 


I 


I 

1 


I 


3.53 


.68 
* 


3.83 


.64 

1 


.362 


.65 


I 


I • 


r 


I 


3.65 


|67 



■ *I«Prpgram not completed 4s yet " , ^ • ' 

1 Table 29 » page 205, provides information which shows no significant changes in attitudes 
toward science teaching by participants in the program components. The participants came, 
into, the program with veVy positive attJ^tudes toward science teaching, and left the program 
with very much the same attitudes. 
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TABLE 29 

t-Tests For Matched Pairs Comparing Semantic Differential: Science Teaching 
Pre- and Posttest Scores Grouped By Program Component 



Program Component 



^valuation ' 
y Potency 
Activity 
Personality 
•Degrees of Freedom 



1 


2 


3 


A 


5 


■ 6 




^ t 


t 


t 


t 


t ■ 




> 


i* 


I 


-0.09 


1.92 


-0.1^ 






1 


1 


0.83 


1.36 


-0.A8 






I 


I 


' -0.07 


0.79 


0.82 






o ; 


I 


1.31 


0.16 


-0.20 






I 


I 


28** 


22*** 


23*** 







* I"Program not completed as yet 
.**^t 2.05 to be significant at the .05 level 
***?t 2.07 to be significant at the .05 level' 

d. Laboratory Work « ^ ' * 

r 

TABLE 30 

^ Means and Standard •Deviations for Semantic Differential Pretest Scores: 

^at) Work Grouped by Program Component 



1 

(n-3) 




Program Components 



(n%it) (n*2?) 



6 

(n-»KJ) 



7 , 
(n-10) 

















/S.D. 


















X . 


S.D.^ 


' X 


S.D. 


X 


S'.D. 




X 


S.J). 


X 


's.D. 


•X * 

c 


S.D. 


X 


S.Dr 


A. 50 


.5/ 


A. 7 7" 


.36 


A. 68 


.AA 


A.A6 


.78 


A. 59 




A. 57 


.51 


A. 67 


.32 


A. 61 


.5A 


3.00 


Ao 


3.25 


.5A 


'3.22 


.26 


3.03 


.53 


3.03 


.31. 


3.00 


.A3 


,3.35 


.A6 


3.13 


•4? 


A. 17 


/.A7 


A. 21 


.A9 


A.A6 


.70. 


A. 07 


.65 


A. 09 




A. 35 




A. 32 


.A6 


A.2A 


.60 


3.7^ 


".Al 


3.50 


.60 


3.^0 


.56 


3.56 


;69 


3.50 


,5.3 


3.50 


.51 


3.\5 


.58 


3.5A 


.59 



Total 

(n«lll) 



32' 
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TABLE 31 • . . 

M^ans and Standard Deviations for Semantic Differential Posttest Scores 
Lab Work Grouped By Program Component " ' « 



E||^luatlon 
P^ency 
ARlvlty 
Pjl^sonallty 



Program Component'., 



3 

(n-29) 



4 

(n=24) 



5 

(n-27) 



Total . 
(n-80) 



X 


S.D. 


X 


S.D. 


X 


S.D, 


X 


S.D. 


'x 


S.D. 


X 


S.D. 


X 


S.D. 


X 


I* 


I 


I 


I 


4.61 


.44 


4.5e 


.51 


4.52 


.42 


I 


i 


I 


I 


4.57 


I 


I 


• I 


I 


3.13 


.31 


3.16 


.57 


3.19 


.49 


I 


.1 , 


I 


I 


3.16 


1 


I 


I 


I 


4.22 


.51 


4.15 


.44 


4.22 


.54 


I 


i 


"l 


I 


4.20 


I 


I 


I 


1 


3131 


.52 


3.42- 


.57 


3.5&^ 


.64 


I 


I 


I 


I 


3.43 



I"Program not completed as yet 



S.D, 



.46 
.46 
.50 
.59 



No significant changes (Table 32) In participant .attitude toward laboratory work . 
were found when pre-^ and posttest scqres on the Semantic Differential test In Sdenqe 
were compared. The participants entered the program with positive attitudes toward, 
laboratory work and these attitude^ apparently remained very positive. 
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TABLE 32 ' ■ . ■ . • 

t-Test For Matched Pairs Compaififlg Semantic Differential: Lab Work " 
• Pre- and Posttest* Scores Grguped By Prpgram .Component 



^ Program Component 



• * 


^ 1 


2 


3 


4 


5 


6 






t * 




t 


t 


t 


t 


t * 

( 


* 

Evaluation 


I* 


• 


■0.69 


0.72 




I 




Potency 


I 




l;a6 


1.07 ■ 


t),^4- 


I 




Activity 


- I 




1.84 


1,16 


0.94 


I 




Personality 






1.53 > 

> 


l.y 


0.18 


I 




Degrees of Freedom ' 


I 




28** 


21*** 


23*** 


. I 


I 



* I«Program not -^^ompleted as yet ^ • ^ 

** t 2.05' ta.b^ significant at the •OS l-evel 
*** t 2107 to ^ significant at the •OS levei 
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2. Participants' Students' Attitude Toward Science 

The attitude of participants' students were obtained on the same concepts as those 
4iscussed for tlie participants* This data is presently being processed. Follow-up 
data will be . c^Jiapared to that collected prior to the teachers', program participation. 
The first foMow*-up data will be collected in the Spring, 197.2. 



r 
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Ill, PROGRAM PROCESS EVALUATION ' ' ■ ^ 

. A Merles of questionnaires were developed which obtained information relative 
to operation of the overall prografb and relative to the specific components. 
Information will be presented and disG;issed relative to the total Program 
operation, but will also include discussion of specific components 9s it is needed. 
This informatioh pertains to all program cjomponents except the Academic Year | 
Institute. * (This information has not been collected from the AYI at thifr point.) 

Data was collected from beginning sequential participants (N-12) and those 
completing sequential programs (N-8). — Lt=was also collected from all participants 
in .unitary components (N«78). The total number of respondents jthat provided data* 
for this section was 98. ^ ' 



In form ation Prior to Arrival iiTTermillicnj 
, ~1. Sources of information about program at U7S.D. 



Approximately 53Z of the pe^rtlcipapts received their information conqfeming 
^^he program from thfe brochure sent o^t by the University. About 35% received 
their information from the NSF broctiure. The test'' received their information from 
■previous participants and other miscellaneous sources. 

2. Number of ina^tltutea^ applied and^ acceptances ' ' 

The mean number of institutes^applied to by. participants was aoprox^mately 
five. *The mean-^number of a^cceptances received was two. 

3. Reason for choosing U.S.D. t 

< 

The two primary reasons for choosing U.S.Di were the University's geof^raphic 
proxlinity to their home and the nature^ of the programs being offered. 



Adequacy of information for making judicious decisions about the institute 

Ninety-six percent of the participants felt the information provicied them was 
adequate. ^ 

5. Adequacy of information after accepting^ institute, with particular ref- 
erence to housing, the corannftiity and the' University , 

Approximately 70% of the^ participants felt adequately 'informed about housing. 
Although the questionnaire solicited specific suggestions for improvement and 
none were received, attention will be given to correcting this ^matter. 

Approximately 80% felt ade quately informed about Vermijlion. Thp very few 
critical comments indicated tha"t" the t^arAcipant was not aware that Vermillion 
was such a small town and found this somewhat disappointing. 

Almost all of the participants felt aderuaCely informed about the University 
and the departments with which they would 1>q working. 
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B. Partlcipaftt and Institutional Coirmitment to Progranv 

6. Could participants continue 'education without NSF assistance? 

There yas a dif;ference in this area between the unitary programs and the ' 
^equentials. Thirty-six percent of the ^jnitary^ partici;p^ts indicated they could 
continue their education without*^? support whereas^^6nly )25Z of the senuential 
participants felt they could do. this. 

7. Discussion of institute participation vith school administrators 

Over 80Z of the participan^ts discussed their institute participation with 
their school principal and approximateiy^ySZ also discussed it with their super- 
intendent. All participants indicated t^at their principal supported theit^ . 
attendJLng the institute". A small number (3X) indicated their superintendent was 
not in sympathy with their attendance* > 

8. Moral and/or financial suppozft from school system as a direct or indirect 
result of U.S.D. Comprehensive Program jkarticipmtion 

Almost all the^ participants indicated their schools -would provide moral 
support for improving the science education program in thei^ schopls. 

Approximately 60% of the participants indicated their schools^ would provide ' 
financial support (equipment, materials, facilities, released time, etc.) for 
the improvement of the science education jirogram in their schools. 

A questionnaire was mailed to the 52 participants who indicated confidence 
in financial* support from their schools asking them to document the nature and 
the amount of this commitment. *Thirty-three questionnaires (66%) were returned. 
The returned questionnaires indicated completed or anticipated expenditures of over 
$38,000.00 on the part of the schools to help the participants improve their scltnce 
education programs. The primary items indicated were instructional materials and 
equipment related to the implementation of science curriculum projects, (Specific 
items and cost are Indicated in the questionnaires, but not included in this document*) 
Some released time was indicated, but the schools' investment in this was not included 
in the figure provided above. Everything considered, the indication is that the 
schools feel a firm commitment to up-gradiog science edtication. , 

Approximately 8Z of the participants received collateral support from their 
school* while participating in the Comprehensive Program, This dollar amount was 
not ascerta:|^ed and is not included in the dollar vlluq provided earlier,* 

C, Course Related Activities 

9. * Field txlps as a part of the progr^ ' , ' 

Approximately 50% of the participants were involved in field trips as a 
part of their program. On a scale of 1 to 4 the field trips received a mean 
rating of 3 which indicated that the participants felt the trips were quite 
successful. When, the participants were asked whether field trips should be a 
part of their institute^ program, SOX responded. yes. Suggestions for^ types of . field 
trips which participants 'felt would be useful were, catalogued, 

10. Desire more work with scienc^e cdurse improvement project materials 
Approximately 75Z of the participants**desire more work with science courMe«^ 



3^ 

improvement project nater'ials. Further clarification of this indicated that 
based on their experiences Wth curricular materials at U.S.D., the/ would like 
more work of this kind.. This response was particularly true of "^a^icipants Xn 
Unitaries directed at familiarization with a particular curriculum project. 

11. Value of introductory courses with graduate credit 

All partici{>ants responded that the availability of introductory science 
courses which they could. take for graduate credit had been very useful. All 
participants felt tha^t the off^ing of these courses should be continued, but - 
they split about 50-50 as -to ^^ther more introductory courses in addition to 
those already available^ ghould fe offered. • * 

12.. ' Desire more work on teaching skills 

Approximately 70% of the JUnitary participants indicated they would like furthex^ 
opportunity to work on teaching skills such as Questioning, or those. dtveloped 
through microteaching. ApproxiiJiately 75% of trflSse completing the sequential 
institute components desired further work in tlvLs axsea. A specific course directed 
at the development of teaching skilly, such as those^'mentioned above, is being 
developed and will be pi^ovided to AYI participants during ^spring, 1972. It is 
anticipated that .work of this type ji^ill be built into other components. 

V ^ * ■ - . 

13. ' Is the degree a ctucial part^f th^r program*? 

, The question as to whether ^he degree was ^ crucial part of their program 
wap posed to participants who were either beginning or completing the sequential 
programs. The question was not asked of participants in Unitarie6,. Approximately 
93% of those beginning programs indicated the degree was crucial and 100% of those 
completing Indicated the degree was crucial. 

* *D. Housing ■ , 

14. Did participants live in Vermillion? 

All the sequential participants on" which data was collected lived in Vermillion 
and 94% of the Unitary participants lived ^n Vermillion. This data supports . • 
that the program is achieving its goal of having participants live in the 
community where the program is held to provide for maximxjm interaction. % 

15. Type of Housing 

* 

Fifty percent of the sequential participants, who, werel* completing tfielr 
program lived in apartments^ in the community and 50% lived in University housing. » 
Ninety- two percent of sequential participants who were beginning the 
program lived in University housing and 8% lived in apartments in the community. 

Unitary institute participants were found to occupy all six types of housing 
indicated on the questionnaire. Hie majority of them, however, resided in either 
University housing (59%) 6r apartments -In town (21%). 

16. Adequacy of housing for participants* needs ' * i 

Over 96% of all participants felt the housing was adequate to meet their needs. 
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17. Ninnber of dependents per participant - 
. The mean number of dependents* per participant was approximately 2.*35. 

I 

18. Participants'' recommendations of housing for future program participants 

Almost all participants indicated they would rerfcommend the housing they had 
utilized for use by future participants. One proljl^Tp area identified was that in 
some instances^ University housing had not been prop^ily cleaned prior to partici- 
pants' occupancy. ^This situation wHl be corrected.' 

19. Amount paid for rent. ' • ' ' 

♦ ♦ ^» ' 

Most participants paid $76 - $90 a month rent and paid thetr own utilities. 
There was some interesting variation in that sequential participants finisj^ing 
their prog.ram averaged over $130 per nfonth, whereas participants beginning the 
sequential program averaged $91 to $!l15 per month. It appears that there is ^ 
tendency for married participants not to bring their families along when they begin 
a seqtiential program, but for those farther along in .the program to have their 
families with them. 

V 

E. Adequacy of Community Resources 

20. , Adequacy of local businesses to mee^ participants* needs 



Approximately 75Z of the participants felt that local businesses were 
adtequate to meet their needs. Most complaints , were typical of those lodged 
against smaller communities^ such as absence.,of night life, inadequate selection 
when shopping, etc. ^ 

21. Adequacy of edting estabXishments 

Approximately 50Z of the participants indicated they normally ate at home 
(no qualitative judgments). The other fifty percent were nearly equally divided 
between local* restaurants and the student union. Reactions were positive and no 
major complaints were registered. ' ^ 

22. Ad'equCacy of Community^ctivlties to meet the needs of the participants' 
^ children ( ' 

Of the. participants who had "children with them, approximately 90Z felt the 
comnunity adequately met the needs of their children. The only complaint regis- 
tered more than once was that some participants were unable to get their children 
enrolled in the community swimming program. The reasons for this will be 
ascertaitied and tlie situation corrected if possible. 

23. Adequacy of community activities to meet the needs of the participants* 
wives. . \ 

Over 95% of those i^articipantd who had their wives with them indicated that 
community activities, were adequate to meet the needs of their wives. . No ptoblem 
areas were identified. - 
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24. Rating on how pleased pe participants were with the way they and their 
fatiiily had been treateti in the community ' " 

(Rating: 4 « extremely pleased, 3 « quite pleased, 2 » somewhrf pleased, 
1 « not pleased)' ^ I ' * 

The mean rating was apptoximately 3 which indicated .that the participants 
were quite pleased with th^ way they had been treated in the co|giunity^ 

F. Activities Related to the NSF-USD Program 

25. Ratings of Comprehensive Components * 

Particlpartts of the^ various program components were asked to rate the program 
they wete pattitipati'rtg in on a scale of one t0^s^ven. 

All institutes received greater than a six rating on a seven point scale. 
(Only the final year participants in the two sequential programs were asked to rate 
the program.) The ratin|s by institute were Sequential Biology 6.5 (N-4), Se- - 
quential Chemistry 6 (^^•4), CHEMS 6.36 (N-28), General Science - Earth Science 
Section 6.29 (N-24), and General Science - Physical Science Section 6.04 (N-25). 

26. Adeqiiacy of institute social activities for participants 

Ov?r 85Z of ^the participants felt that the institute social activities were 
adequate for their needs. Sequential Chemistry, CHEMS, and General Science - 
IPS Section each had a few people who felt the social activities were inadequate. 
This will be looked at further to determine If any changes are needed. Specific 
recommendations were solicited from participants, but none were provided. 

27. Adequacy of social act^Svtfies for family 

All the sequent'ial and-, unitary general science participants felt that ^.nsti- 
tute social activities were adequate for their familias. ^Approximately 80% of 
the CHEMS participants felt that social activities were^fl^dequate for their families. 
The CHEMS program wi;Ll look at this situation further to see if changes are" needed. 
Specific recommendations were solicited from participants, but none were provided. 

28. Adequacy of opportunity for participants to interact with students in other 
programs - 

The people beginning the Biology Sequential aAd the General Science participants 
all felt that they had adequate opportunity to react with students from other pro- ' 
grams'. 

• 

Approximately 60% of the people in the CH^Mb and 50% of the beginning par- 
^ ticipants in the Chemistry Sequential felt they had adequate opportunity to inter- 
act with participants from other programs. This situation will be looked at further 
■ to see if more opportunities for between-group participant Interaction should be 
built into the CHEMS and Chemistry Sequential Components.' * 



29. Participants^* understanding of prp^ram jsvaluation 

Approximately 95% of the participants indicated they understood the reasons 
for the over-all program evaluation. 
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30., Value of orogram evaluation ^ , > 

Approximately 95Z of all participants felt the program evaluation \^as worth- 
'while^ > ' , , , 

iff 

31,. Time involved in program evaluation * . ■ 

Approximately 30% of" all participants felt that too much time was involved 
in program evaluation. The primary complaint was against the namount of classroom 
time required for collecting data from their students. It is doubtful that this 
testing time can he reduced, but the instruments will be delivered to the teachers 
earlier so that the testing will not come at the veiry end .of the school year. This 
should help alleviate the. problems since teachers feel very pressed for time as 
they near the jcompletion of the school year. 

'32. Collecting d^ta from participants' students 

\\ ' 

Approximately 40% of fche participant!? indicated they^had difficulty in 
collecting the data from their students. "^The two primary problems were that ^Only 
a small sample was randomly selected from each of their classes and the fact that 
participants teceived the materials too late in the school year, the latter 
problem is easily solved and the first one will be worked on prior to, the next 
d^ta collection.^ « , ^ 

. 33. Adequacy of direction^ for collect^g d^ta from participants* student^>^ 

J Eighty jJercent of the participants felt that the axrections they used for 
collecting data from their students were. ade(^uate« The major problem seemed to 
b^ in randomly selecting students from classes. This procedure can, be simplified, 
but probably not t;o everyone's satisfactidn. 

Gi General Participant 'Information i " * . . 



34. Do 'participants return to school they taught at prior to program 
\ participation? 



, V Sixty- three percent of the participants completing the Sequential Programs 
e^ni^ 9'^% of those beginning the Sequential Prognams returned to the school they 
taught at pj^or to program participation. Seventy-eight percent ot the people in 
the^^CHEMS component and over 90% of the people in the General Science Component 
retU|Ti'e4 to the scliool they taught at .priot to program participation. The specific 
reasons for teachers leaving schools, are being catalogued and may projvide some 
xi^efiu longitudinal information. ' | * ^ , 

35. Whf t>^'ubjeqts, grade' levels, and in lhat size schools, do p;articipant8 
, , V desire %o teach? ■ * 

Participants Were adked to respond to the question^ "What subjects, what grade 
level (d), and in what size school^ they would teach if they had complete choice in 
the matter and salary was not a factor?" Information on ^this question will be 
presented und^r eacli prograia component. * 
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a.) Glan^ral Science Component ^ 

. ApptoximatMy eighty percent of the General Science Participants indicated they 
woujd lite to continue teaching general science or some combination of subjects which 
included general scietice. Mathematics was the most frequent companion ( 20%) when 
participants listed more'' than one subject. 

Approximately .85% of the General. Science participants'^wb^uld choose to work at ' 
least some of the day .with students ninth grade' level or below. Approximately 60% 

feV to work 



indicated they would ptefel 



>r}c exclusively with these younger students. 



The General Science- participants, if given their choice, would choosy to work in 
schooJLs. having student' enrollments of approximately 650 students. Furthet analysis 
/reveals.' that those ii? the Earth Science Section prefer aft average school size of 800 
students, ^whereas the participants in the Physical Science section prefer, on the 
average, a school of about 475, students. 

b.) CHEMS Component * 

Sey^ntiy-f ive percent of the, 6HEMS partjicipants would like to teach chemistry or 
some combi^tion of subjects including chemistry." There wajs' no' one particular subject, 
which, was picked most frequently as a companion v^en participants listed more than one,- 
subject* ' ' 



Seventy-fiVe p'ercent of the (JHEMS. participants would choose to work at 
of the day with stiidents of .te^th grade level or fijbove. .Approximately 50% 
tfiey ^referr.ed to work exclusively with tenth ,^ra& students or older. 



loaat 



_ tome 
dfcate • 



The CHEMS participants wqiild prefer, on the average, to teach in'achools 
erirQllments of 55'0|sVadents. 



with 



H.^ Sequential Institutes- . \ . . / 

/ -..M ■ V ' ■ ' « . / 

The Biology Sequential people all prefer to teach biology or biology i plus spme 
otjher siflpject/* THe Chemist rySequential p^trticipan^s^ all prefer to teacn chemistry 
or chemistry plus some other'*Subject. This seems to be true of participants beginning 
the program and those completing i^. Hie number of participants for whjJdh we have ,. 
this tyt>e of data is too smaili however, .to make a strong generalizatior . ^ 



completing 

10 through 
was stronger 



.; Almost all Sequential J)a,rticipants, those beginning (n-12) and thos 
thej^prdgram (Ti",8), 'indicate tl>fey would prefer to teach at the grade levils 
. 12- ^ Although the..number of respondents "was j^mall, it appeared this tretid 
iff. those; participa^s completing the progrfimi-. ^ ' 

/Sisc^uentlaJ participants, if given their choice, would cl^oose to wo.r c in schools ! 
having a student enrollment of ajpip.roximately 1000 students. Further anilysis revealis, 
however, t^^at thi^may depend on t^ether you. look at participants who a re beginning the 
program or thp^e completing it. It also may depend on the subject area of the part-^l 
icipant. Begltmlng participants .ii^dicate the ideaj 6ii?e school for theici Jias approx- 
ipiately 600 ^students, whereas thoai participants completing programs indicate they would 
rither teach .in a ifchool of approximately 1500 students. There also ap)ears to be ^ \* 
tendency for cbtSnistiry.^teacners tQ prefer somewhat larger schools than biology teachera* 
A note of cautloil should b^ 'includec^ herein tl^at the abpve statements are based on 



relatively small ''samples and the statoments could be very biased. 

\ . Ill ■ • ^ ' 
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IV.' • RANKING OF PROGRAM OBJECTIV?S 
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Comprehensive Program participants and staff were'^aaked to rank ordeo: 
program objectives. This was done for 'each program component. 

A questionnaire was developed which listed a series of objectives \i^ich 
wqre to be rank ordered. The list of objectives was developed from the Prograa 
proposal and then modified based on inputs from staff and participants. 
Participants and staff were asked to rank order the objectives beginning with \ 
one (1) as the most important and to progress to what th^y felt was the least, 
import an tf objective. Participants were asked to do this in terms of what they 
felt were their greatest needs. Staff were asked to rank order in tenns of 
what they felt were thfe participants greatest netads. No two objectives could 
be given the same value rating. ' 

Table 33 provides information on how participants and staff rank ordered 
program objectives. The mean rank ordering for the total participants and the 
^j^otal staff is provided. The Information is also broken down according to 
^i!>rDgram com{(onent. ' ^ 

Observation of Table 33 indicates that^ participants and staff are in fairly 
good agreement as to the relative ranking of objectives. Subject matter 
competency la rated by participants and staff as by far the most important 
objective for the Comprehenslv^Sh:l)gram. Developing an understanding of. the 
nature of science, using s-dence instructional activities consistent with 
contemporary objectives of science education, th^ infp lament at 1^ of new 
currlcular materials in the schools of the region, and participants functioning 
as a source ot innovation in their schools were other objectives which received 
high ratings from participants and staff. , ' 



The rank order for some ojDjectlves was quite different from one coiiq)on6nt 
to another. This Is not unexpected when the nature of the components and 
ttfe needs to which the different components are addressed is considered. 

The li!q>ortance which was assigned to various objectives has been taken 
into consideration in Comprehetisive Program ^Evaluation. They are also being 
taken into account in program development. | 

^ Code for Program Coimonents 

^- J • ' '\ ' ^ . 

1 « Sequential Biology Coioponent \ 

2 ■ Sequentljal Chemistry Component ' ^ ✓ n ' ^ 
3'» Unitary CHEMS Coiiq>onent * ' 

4 ^ Ear-th-Sdence. Section of Generail Science Component 

5 " P.hyslcal Science Section of General Science Component 

6 ■ Academic Year Goiiq>otient 
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V; SUMMARY I . 

vDac'a was collected and analyzed related^rto the' foilowing four primary areas: 
^1. 'Descriptive Information on Participants * 
H. Evaluation^ of Program Objectives 

* 

III. Program Process gvaliiatlon 

IV. Rank Ordering of Program Objectives ' 
« * , 

r Some major points discerned from these four areas were: 

1. The Comprehensive Program has made significant progress toward serving 
onlyi^the North Central ^Plains Region. 

2. Participants in the program. normally teach more than one science subject 
arid at more than one grade level. Many of the participants have at 
least some teaching responsibility at. the Juriior High School level. 

3* The participants enjoy teaching science and they HTce the students they . 
teach. , 

4. The participants entered the program in generally good agreement wi^h ' 
science educators as to the types of classroom knd laboratory activities 
which should be used^for Secondary school scierrce Instruction. The 

\ program components/ in general, contributed positively toward strengthening 
-'this agreement^ — • ^ • * ^ 

5. The science laboratory does not appear to be a major part, of participants^ 
science instruction in grades 7-9. This statement is based on the amount 
of time participants report that their students spend in the laboratory. 

. 6. The participants have* fairly positive attitudes toward thctr science 
facilities, equipment, and materials. One would assume there is a 
relationship between this finding and number five above,. but at this time 
tft^t , relationship is sheer -speculation. * ^ * * ' ^ 

7. Partici]p^ants' ih all prdferams, where data was available, showed significant 
progress in. subject matter competencies by the completion of the. program. 

\ ?* . Little phange could be not-ed on the participant attitude measures used 

as prte- and posttests. It should be noted, hoJwever, that pretest attitude 
scdres were quite high. ^ , . 

/ • . V ^ ' ' ^ j 

9. In gener^il^ participants were pleased with their respective program 
, components, the. University of South Dakota, and the City of Vejmillioh. 
Vfher^ problems Vere uncovered, avenues foi; improvement are being pursued." 

.10. ' Datta ^collected on participants' students is being p^rocessed. No comparative 
informa.tlon will be available until follow-up data is collected in Spfring, 



